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(54) Virtual memory system. 

(57) An apparatus and method for reducing the 
cache miss penalty in a virtual memory system 
is provided. The virtual memory system includes 
a processor core which generates virtual ad- 
dresses and a cache configured to supply infor- 
mation in response to receipt of physical 
addresses. The apparatus includes a logical- 
to-physical translation unit which converts the 
virtual addresses generated by the processor 
core to physical addresses. The logical-to- 
physical translation unit includes an accurate 
translation unit a speculative translation unit, 
and a comparing unit The accurate translation 
unit accurately converts logical addresses to 
physical addresses. The speculative translation 
unit generates and transmits a speculative 
physical address to the cache before the accu- 
rate translation unit completes generation of 
the accurate physical address. When the accu- 
rate translation unit completes generation of 
the accurate physical address, the comparing 
unit compares the accurate physical address 
with the speculative physical address. If the 
accurate physical address does not match the 
speculative physical address, the transmission 
of the speculative physical address to the cache 
is aborted, and the accurate physical address is 
transmitted to the cache. 
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The present invention relates to a method and ap- 
paratus for decreasing the average time required to 
retrieve information required by a processor, and 
more particularly to an apparatus and method for re- 
ducing the cache miss penalty in a caching system by 
generating a speculative physical address In parallel 
with the translation of a virtual address to a physical 
address. 

One way to increase the performance of a com- 
puter system is to decrease the time required to sup- 
ply a microprocessor with the information it requires. 
Such information, which may include both data and 
instructions, is typically stored in a memory connect- 
ed to the microprocessor. To access required informa- 
tion, the microprocessor transmits to the memory an 
address which corresponds to the physical location in 
the memory (the "physical address") in which the re- 
quired information is stored. In response, the memory 
transmits back to the microprocessor the information 
stored in memory location designated by the physical 
address. 

The time required to supply a microprocessor 
with required information may be decreased by de- 
creasing the time lapse between the memory's re- 
ceipt of the physical address and the transmission of 
the required information. This time lapse is deter- 
mined by the "speed" of the memory. Unfortunately, 
the cost of memory increases dramatically with the 
speed of the memory. Thus, it is rarely practical to use 
the fastest memory available, especially En systems 
which require large quantities of memory. 

Consequently, it has been discovered that by us- 
ing a relatively small bank of relatively high-speed 
memory ("cache memory") as a buffer for a larger 
bank of slower memory ("system memory"), the aver- 
age information-request to information-supply speed 
can be greatly improved. Specifically, in a system 
having a cache memory (a "cache system"), the mi- 
croprocessor initially requests information it needs 
from the cache memory. If the information is stored 
in the cache memory, the request is said to be a 
"cache hit" and the information is provided to the mi- 
croprocessor from the cache memory at the faster 
rate. If the required information is not stored in the 
cache memory, the information request is said to be 
a "cache miss" and the information is retrieved from 
the system memory at the slower transfer rate. When 
the information is supplied to the microprocessor 
from the system memory, a copy of the information is 
typically stored in the cache memory in anticipation 
of subsequent requests for the same information. The 
computational efficiency lost due to a cache miss is 
referred to herein as the "cache miss penalty." 

Many modern computer systems are designed to 
allow software to address "virtual memory" using "vir- 
tual addresses", rather than the actual memory on 
the system using physical addresses. In a system that 
supports virtual memory (a "virtual memory sys- 



tem"), the software is allowed to assume that the 
process it implements may access the system's en- 
tire address space, that the memory is contiguous, 
and that the memory begins at a particular address. 
5 Due to these assumptions, the software need not be 
aware of the actual configuration or usage of the sys- 
tem's memory. Virtual memory systems and the ben- 
efits thereof are described in detail by David A. Pat- 
terson and John L Hennessy in Computer Architec- 
10 ture A Quantitative Approach (1990), published by 
Morgan Kaufmann Publishers, Inc. San Mateo, Cali- 
fornia, published by Morgan Kaufmann Publishers, 
Inc. San Mateo, California, published by Morgan 
Kaufmann Publishers, Inc. San Mateo, California, pa- 
ts ges 432-454. 

In virtual memory systems, information must still 
be stored in the actual system memory. Thus, virtual 
memory systems must provide a mechanism for 
translating the virtual addresses generated by the 
20 software into physical addresses corresponding to 
actual memory locations of the system memory. One 
mechanism commonly used to perform this transla- 
tion is a translation-lookaside buffer. The concept of 
translation-lookaside buffers is generally well-known 
25 in the art, and is described in detail by David A. Pat- 
terson and John L Hennessy in Computer Architec- 
ture A Quantitative Approach (1 990), pages 437-438. 

Similar to non-virtual memory systems, virtual 
memory systems may employ caching techniques to 
30 decrease the time required to retrieve required infor- 
mation. Virtual memory systems may be designed 
with cache memories which supply required informa- 
tion in response to physical addresses fphysical-ad- 
dress-indexed caches"), cache memories which sup- 
35 ply required information in response to virtual ad- 
dresses ("virtual- address- indexed caches'*), or both. 
Virtual-address-indexed caches are described in de- 
tail by David A Patterson and John L. Hennessy in 
Computer Architecture A Quantitative Approach 
40 (1990), at page 460. 

When information is required in a virtual memory 
system which employs both a physical-address-in- 
dexed cache and a virtual-address-indexed cache, a 
search for the desired information is performed in the 
45 virtual-address-indexed cache while the virtual ad- 
dress is translated to a physical address. If the de- 
sired Information is not present in the virtual-address- 
indexed cache, the processor awaits the result of a 
search for the desired information in the physical-ad- 
50 dress-indexed cache. Such a search is begun only af- 
ter the process of determining a physical address is 
completed. Information retrieval from the physical- 
address-indexed cache is slower then retrieval from 
the virtual- address- indexed cache since a translation 
55 delay is imposed prior to the search of the physical- 
address-indexed cache. Thus, a cache miss in the vir- 
tual-address-indexed cache results in a cache miss 
penalty. 
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In light of the foregoing, in a virtual memory sys- 
tem having a virtual-address-indexed cache and a 
physical-address-indexed cache, a method and ap- 
paratus for reducing the cache miss penalty caused 
by a cache miss of the virtual-address-indexed cache 
is clearly desirable. Further, it is clearly desirable to 
provide an apparatus and method for avoiding the 
logical-to-physical address translation time for at 
least some cache information retrievals from the 
physical-address-indexed cache. 

SUMMARY OF THE INVENTION 

According to one aspect of the present invention, 
an apparatus for use in a virtual memory system for 
reducing the delay between generation of a virtual 
address by a processor core and transmission to a 
memory of a physical address corresponding to the 
virtual address Is provided. The generation of the vir- 
tual address by the processor core effects a request 
for required information. The apparatus includes a 
translation lookaside buffer operatively connected 
with the processor core and the memory for receiving 
the virtual address and generating an accurate phys- 
ical address, and a speculative address generating 
means operatively connected with the translation loo- 
kaside buffer and the memory for generating a spec- 
ulative address. The speculative address generating 
means transmits the speculative address to the mem- 
ory prior to the translation lookaside buffer generat- 
ing the accurate physical address. The apparatus fur- 
ther includes comparing means, operatively connect- 
ed with the translation lookaside buffer, the memory 
and the speculative address generating means, for 
comparing the accurate physical address with the 
speculative address. The comparing means trans- 
mits the accurate physical address to the memory 
when the accurate physical address does not match 
the speculative address. 

According to another aspect of the present inven- 
tion, an apparatus for reducing the time required for 
a processor core in a virtual memory system to re- 
trieve information from a memory configured to sup- 
ply information in response to a physical address is 
provided. The apparatus generally includes accurate 
physical address generating means, operatively con- 
nected with the processor core and the memory, for 
receiving a virtual address corresponding to an accu- 
rate physical address and for generating the accurate 
physical address. The apparatus further includes 
speculative address generating means, operatively 
connected with the memory, for generating a specu- 
lative physical address prior to the accurate physical 
address generating means generating the accurate 
physical address. The speculative address generat- 
ing means transmits the speculative physical address 
to the memory to initiate a first lookup operation in the 
memory based on the speculative physical address. 



The apparatus further includes comparing means op- 
eratively connected with the accurate physical ad- 
dress generating means, the memory and the spec- 
ulative address generating means for receiving the 

5 accurate physical address from the accurate physical 
address generating means and receiving the specu- 
lative physical address from the speculative address 
generating means. The comparing means compares 
the accurate physical address with the speculative 

10 physical address and transmits the accurate physical 
address to the memory to initiate a second lookup op- 
eration based on the accurate physical address when 
the accurate physical address is different from the 
speculative physical address. 

15 According to another aspect of the invention, a 

logical-to-physical address translation unit for trans- 
mitting a physical address over a bus In response to 
a virtual address is provided. The logicaMo-physical 
address translation unit Includes accurate translation 

20 means for receiving the virtual address and translat- 
ing the virtual address to an accurate physical ad- 
dress, and speculative translation means, operatively 
connected with the accurate translation means, for 
generating a speculative physical address. The logi- 

25 cal-to-physical address translation unit further in- 
cludes comparing means operatively connected with 
the accurate translation means, the speculative 
translation means and the bus, for transmitting the 
speculative physical address as the physical address 

30 over the bus prior to completion of the generation of 
the accurate physical address, for comparing the ac- 
curate physical address with the speculative physical 
address, and for aborting transmission of the specu- 
lative physical address over the bus and initiating 

35 transmission of the accurate physical address over 
the bus when the accurate physical address does not 
match the speculative physical address. 

According to yet another aspect of the invention, 
a virtual memory system is provided. The virtual 

40 memory system includes a processor core disposed 
to generate a virtual address representative of re- 
quired information and a first cache disposed to sup- 
ply information in response to virtual addresses. The 
first cache is operatively connected with the proces- 

45 sor core for receiving the virtual address from the 
processor core. The first cache includes a first plur- 
ality of storage locations for storing Information. The 
first cache, in response to receipt of the virtual ad- 
dress, transmits the required information to the proc- 

so essor core when the required information resides in 
the first plurality of storage locations. The virtual 
memory system further includes a logicaMo-physical 
address translation means, operatively connected 
with the processor core, for receiving the virtual ad- 

55 dress, for generating a physical address in response 
to the virtual address, and for transmitting the phys- 
ical address, and a second cache disposed to supply 
information In response to physical addresses. The 
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second cache is ope natively connected with the logi- 
cal-to-physical translation means and to the proces- 
sor core, for receiving the physical address from log- 
icaf-to-physical translation means. The second cache 
includes a second plurality of storage locations for 
storing information. The second cache initiates a 
lookup operation for the required information in re- 
sponse to receipt of the physical address. The second 
cache transmits the required information to the proc- 
essor core when the required Information resides in 
the second plurality of storage locations. 

The logical-to-physical translation means in- 
cludes accurate translation means for receiving the 
virtual address and translating the virtual address to 
an accurate physical address and speculative trans- 
lation means, operatively connected with the accu- 
rate translation means, for generating a speculative 
physical address. The logical-to-physical address 
translation means further includes comparing means 
operatively connected with the accurate address gen- 
erating means, the speculative address generating 
means and the second cache, for transmitting the 
speculative physical address as the physical address 
to the second cache prior to completion of the gener- 
ation of the accurate physical address, for comparing 
the accurate physical address to the speculative 
physical address, and for aborting transmission of the 
speculative physical address to the second cache 
and initiating transmission of the accurate physical 
address to the second cache when the accurate phys- 
ical address does not match the speculative physical 
address. 

According to yet another aspect of the invention, 
a method for converting a virtual address to a physi- 
cal address in a system including a processor core 
configured to generate the virtual address to request 
required information from a memory is provided. The 
method includes the steps of initiating a conversion 
operation to convert the virtual address to an accu- 
rate physical address, generating a speculative phys- 
ical address, transmitting the speculative physical 
address to the memory prior to completion of the con- 
version operation, and comparing the accurate phys- 
ical address to the speculative physical address. The 
method further comprises the steps of terminating the 
transmission of the speculative physical address to 
the memory, and initiating transmission of the accu- 
rate physical address to the memory, when the accu- 
rate physical address does not match the speculative 
physical address. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The features of the present invention, are set 
forth with particularity in the appended claims. The in- 
vention, together with further objects and advantages 
thereof, may best be understood by making reference 
to the following description taken in conjunction with 



the accompanying drawings, in the several figures of 
which like reference numerals identify tike elements, 
and wherein: 

Figure 1 illustrates in block diagram form a virtual 
5 memory system according to the preferred em- 

bodiment of the invention; and 
Figure 2 illustrates in block diagram form the pre- 
sently preferred embodiment of a logical-to-phys- 
ical translation unit. 

10 

DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENT 

Figure 1 illustrates in block diagram form a virtual 

15 memory system 10 according to the preferred em- 
bodiment of the invention. Virtual memory system 10 
generally includes a processor core 12, a virtual-ad- 
dress-indexed cache memory 14, a physical-ad- 
dress-indexed cache memory 16 and a logical-to- 

20 physical translation unit 18. 

Processor core 12 generally represents those 
components in a processor 1 3 which decode and exe- 
cute instructions. Processor core 12 is coupled to 
physicai-address-indexed cache memory 16 through 

25 a line buffer 20 by a plurality of data buses 22 and 24. 
Processor core 12 is coupled to logical-to-physical 
translation unit 18 by a virtual address bus 26 and by 
a required-information status line 30. Processor core 
12 is also coupled to virtuaJ-address-indexed cache 

30 memory 14 by virtual address bus 26. Since system 
10 is a virtual memory system, the instructions exe- 
cuted by processor core 1 2 refer to logical addresses 
rather physical addresses. When information is re- 
quired by processor core 12, processor core 12 gen- 

35 erates a virtual address identifying the logical loca- 
tion of the required information. Processor core 12 
further generates a status signal over line 30 indica- 
tive of whether the required information is data or an 
instruction. 

40 Virtual-address-indexed cache memory 14 is in- 
ternal, residing on processor 13 with processor core 
12. Virtual-address-indexed cache memory 14 is 
coupled to data bus 22 and Includes a plurality of stor- 
age locations 15. Virtual-address-indexed cache 

45 memory 14 is arranged to transmit information stored 
within its storage locations 15 in response to virtual 
addresses received from processor core 12 over vir- 
tual address bus 26. 

Physical-address-indexed cache memory 16 is 

so external, residing exterior to processor 13. Physical- 
address-indexed cache memory 16 is coupled to log- 
ical-to-physical translation unit 18 and line buffer 20 
by a physical address bus 32 and a speculative read 
control line 33. Physical-address-indexed cache 

55 memory 16 includes a plurality of storage locations 
17 for storing information, and control circuitry for 
supplying over data bus 24 information stored in stor- 
age locations 17. In contrast to virtual-address-in- 



7 



EP0 668 565 A1 



a 



dexed cache memory 14, the information within stor- 
age locations 17 is supplied by physical-address-in- 
dexed cache memory 16 in response to physical ad- 
dresses. 

Since physical-address-indexed cache memory s 
16 supplies information in response to physical ad- 
dresses, the virtual addresses generated by proces- 
sor core 12 must be translated by logical-to-physical 
translation unit 18 into physical addresses before re- 
quired information can be retrieved from physical-ad- 10 
dress-indexed cache memory 1 6. 

The process by which processor core 12 re- 
trieves required information shall now be explained in 
greater detail. As mentioned above, when processor 
core 12 requires information, processor core 12 gen- 15 
erates a virtual address indicative of the required irrv 
formation. Processor core 12 transmits this virtual 
address on virtual address bus 26. Both logical-to- 
physical translation unit 18 and virtual-address-in- 
dexed cache memory 14 receive the virtual address- 20 
es transmitted by processor core 12 over virtual ad- 
dress bus 26. In response to the receipt of the virtual 
address, logical-to-physicaJ translation unit 18 begins 
to translate the virtual address to a physical address. 
Simultaneously, virtual-address-indexed cache 25 
memory 14 determines whether the required informa- 
tion currently resides in any of its storage locations 
15. If the required data does reside in one of storage 
locations 15, virtual-address-indexed cache memory 
14 transmits the required information to processor 30 
core 12 over data bus 22. 

If the required data does not reside in any of stor- 
age locations 15, logical-to-physical translation unit 
18 completes the translation of the virtual address 
into a physical address, and generates the physical 35 
address to physical-address-indexed cache memory 
16 over physical address bus 32. Upon receipt of the 
physical address, physical-address-indexed cache 
memory 16 performs a search to determine if the re- 
quired information resides in storage locations 17. If 40 
the required information is found, physical address- 
based cache memory 16 transmits the information to 
processor core 12 through line buffer 20 over data 
buses 24 and 22. Virtual-address-indexed cache 
memory 14 may optionally be configured to read and 45 
store the information sent from physical-address-in- 
dexed cache memory 16 to processor core 12 into 
one of its storage locations 15 in anticipation of later 
requests for the same information. 

Logical-to-physical translation unit 18 generally so 
includes an accurate address generating unit 40 and 
a speculative address generating unit 42. When log- 
ical-to-physical translation unit 18 receives a virtual 
address on virtual address bus 26, accurate address 
generating unit 40 and speculative address generat- 55 
ing unit 42, In parallel, generate physical addresses. 

Accurate address generating unit 40 is config- 
ured to generate physical addresses that always ac- 



curately correspond to the storage locations indicated 
by the received virtual addresses ("accurate physical 
addresses"). Thus, accurate address generating unit 
40 may be, for example, a translation lookaside buffer 
implemented as commonly known in the art. 

The logical-to-physical address translation proc- 
ess implemented by speculative address generating 
unit 42 differs from that implemented by accurate ad- 
dress generating unit 40 in twosignif icant ways. First, 
the process implemented by speculative address 
generating unit 42 need not guaranty that the gener- 
ated physical address will be accurate. Second, the 
process implemented by speculative address gener- 
ating unit 42 must complete the generation of a spec- 
ulative address in less time than it takes for accurate 
address generating unit 40 to generate the accurate 
physical address. As long as these two criteria are 
met, the specific embodiment of speculative address 
generating unit 42 may vary. The presently preferred 
embodiment of speculative address generating unit 
42 is responsive to the status signal on line 30, and 
will be described in greater detail below. 

Thus, after logicaJ-to-physica! translation unit 18 
receives a virtual address, and while accurate ad- 
dress generating unit 40 is determining the accurate 
physical address, speculative address generating 
unit 42 completes generation of a speculative ad- 
dress. Logical-to-physical translation unit 18 trans- 
mits the speculative address to physical-address-in- 
dexed cache memory 16 to Initiate a lookup operation 
based on the speculative address. Logical- to- physi- 
cal translation unit 18 further transmits a signal over 
line 33 to indicate that the physical address currently 
being supplied to physical-address-indexed cache 
memory 16 is a speculative address. For example, 
logical-to-physical translation unit 18 may drive line 
33 HIGH when the physical address currently being 
supplied to physical-address-indexed cache memory 
16 is a speculative address. 

Accurate address generating unit 40 completes 
generation of the accurate physical address after the 
generation of the speculative address, but prior to the 
completion of the lookup operation based on the 
speculative address. When accurate address gener- 
ating unit 40 completes generation of the accurate 
physical address, logical-to-physical translation unit 
18 compares the accurate physical address with the 
speculative address. If the speculative address is the 
same as the accurate physical address, then the look- 
up operation based on the speculative address is al- 
lowed to complete. If the required information is found 
in physical-address-indexed cache memory 16, it is 
supplied to processor core 12 through line buffer 20 
via data buses 24 and 22. 

On the other hand, if the accurate physical ad- 
dress is different from the speculative address, logi- 
cal-to-physical translation unit 18 aborts the trans- 
mission of the speculative address over physical ad- 
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dress bus 32, begins transmitting the accurate phys- 
ical address to physical-address-indexed cache 
memory 16 over physical address bus 32, and trans- 
mits a signal over line 33 indicating that the address 
on bus 32 is not a speculative address. For example, 5 
logical-to-physicai translation unit 18 may drive line 
33 LOW when the physical address currently being 
supplied to physical-address-indexed cache memory 
16 is not a speculative address. 

Because the control signal on line 33 changes 10 
state when the transmission of the speculative ad- 
dress is aborted and the transmission of the accurate 
physical address is initiated, the control signal effec- 
tively indicates to memory 16 the outcome of the com- 
parison of the speculative address and the accurate 15 
physical address. While the control signal on line 33 
has been described herein as one which changes 
states to indicate the outcome of the comparison of 
the speculative address and the accurate physical ad- 
dress, the specific signal indication used to indicate 20 
the comparison outcome may vary. 

Upon receipt of the new address on bus 32 and 
the change in the signal over line 33, the control cir- 
cuitry of physical-address-indexed cache memory 16 
aborts the lookup operation based on the speculative 25 
address and initiates a lookup operation based on the 
accurate physical address. If the required information 
is found in the physical-address-indexed cache mem- 
ory 16, it is supplied to processor core 12 through line 
buffer 20 via data buses 24 and 22. 30 

When the speculative address is inaccurate, 
physical-address-indexed cache memory 16 re- 
ceives the accurate physical address over physical 
address bus 32 in substantially the same amount of 
time it would have taken to generate the accurate ad- 35 
dress in the absence of speculative address generat- 
ing unit 42. Hence, no additional delay is imposed by 
the parallel address generation of speculative ad- 
dress generating unit 42. On the other hand, when the 
speculative address is accurate, the physical-ad- 40 
dress-indexed cache memory 16 is able to supply 
processor core 12 with required information faster 
than is possible in systems which rely exclusively on 
always-accurate togical-to-physical address transla- 
tion techniques. 45 

The actual performance increase obtained by op- 
erating speculative address generating unit 42 in par- 
allel with accurate address generating unit 40 de- 
pends on how quickly and how accurately the process 
implemented in speculative address generating unit so 
42 can predict the correct physical address. The pre- 
sently preferred-embodiment of a speculative ad- 
dress generating unit shall now be described in great- 
er detail with reference to Figure 2. 

Figure 2 illustrates in block diagram form the pre- 55 
sently preferred embodiment of logical-to-physical 
translation unit 18. Logical-to-physical translation 
unit 18 is arranged to work with processor core 12 of 



a virtual memory system which employs virtual page 
techniques to implement virtual memory (a "virtual 
page system"). In virtual page systems, the storage 
locations in system memory are divided into a plural- 
ity of equal-sized groups, called pages. Each page 
has a physical page address which uniquely identi- 
fies the page, and each storage location within each 
page has a unique offset from its respective physical 
page address. Thus, information in any given storage 
location in the system memory may be accessed by 
sending to the system memory a physical address 
containing the physical page address and the offset 
which, together, uniquely identify the designated stor- 
age location. 

In virtual page systems, software references 
storage locations in the system memory by virtual ad- 
dresses which include a virtual page address and an 
offset The offset component of a virtual address is 
identical to the offset component of the physical ad- 
dress of the storage location represented by the vir- 
tual address. Therefore, the offset portion of virtual 
addresses need not be changed during the logical-to- 
physical address translation process. The virtual 
page address portion of the virtual address, however, 
must be translated into the physical page address to 
which it corresponds before information can be re- 
trieved from the system memory. 

Because processor core 12 belongs to a virtual 
page system, virtual addresses generated by proces- 
sor core 12 include a logical page address and an off- 
set. Virtual address bus 26 includes a logical page ad- 
dress bus 58 over which the logical page address por- 
tion of each virtual address is transmitted to memory 
16, and an offset bus 60 over which the offset portion 
of each virtual address is transmitted to memory 16. 

Logical-to-physical translation unit 18 generally 
includes a translation lookaside buffer 62, specula- 
tive address generating unit 42, and a comparing unit 
68. Translation lookaside buffer 62 is coupled to proc- 
essor core 12 by logical page address bus 58. Trans- 
lation lookaside buffer 62 is also coupled to specula- 
tive address generating unit 42 by a bus 73. Specu- 
lative address generating unit 42 is further coupled to 
processor core 12 by line 30. Logical-to-physical 
translation unit 18 is coupled to physicaJ-address-in- 
dexed cache memory 16 by physical address bus 32 
which includes physical page address bus 58 coupled 
to comparing unit 68, and offset bus 60. 

Speculative address generating unit 42 generally 
includes control logic 84, an instruction address latch 
86 a data address latch 88 and a multiplexer 90. Con- 
trol logic 84 is coupled to control line 33, to instruction 
address latch 86 by a line 92, to data address latch 88 
by a line 94, to multiplexer 90 by a line 96, to compar- 
ing unit 68 by a line 95, and to processor core 12 by 
line 30. 

The operation of logical-to-physical translation 
unit 18 shall now be explained in greater detail. Log- 
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ical-to-physical translation unit 18 receives from 
processor core 12, over virtual address bus 26, a vir- 
tual address which identifies the storage location that 
holds required information. More specifically, the log- 
ical page address corresponding to the required infor- 
mation's physical storage location is transmitted on 
logical page address bus 58, and the offset corre- 
sponding to the required information's physical stor- 
age location is transmitted on offset bus 60. Proces- 
sor core 12 also transmits over line 30 a signal indi- 
cating whether the required information represents 
an instruction or data. 

In response to the virtual address, translation 
lookaside buffer 62 begins converting the logical 
page address of the virtual address to an accurate 
physical page address. Simultaneously, speculative 
address generating unit 42 causes a speculative ad- 
dress to be sent to memory 1 6 over physical page ad- 
dress bus 58 via comparing unit 68 and a bus 74, and 
control logic 84 transmits a signal to memory 16 on 
line 33 to indicate that the physical address on bus 32 
is a speculative address. In response to receipt of the 
speculative address on bus 32 and the signal on line 
33, memory 16 initiates a lookup operation based on 
the speculative address. 

When translation lookaside buffer 62 finishes 
translating the logical page address to an accurate 
physical page address, translation lookaside buffer 
62 transmits the accurate physical page address to 
the comparing unit 68 over a bus 72. Comparing unit 
68 compares the accurate physical page address with 
the speculative page address. If the accurate physical 
page address matches the speculative page address, 
then the comparing unit 68 completes the transmis- 
sion of the speculative page address over physical 
page address bus 58 and memory 16 completes the 
lookup operation based on the speculative address. 

If the accurate physical page address does not 
match the speculative page address, then comparing 
unit 68 ceases to transmit the speculative page ad- 
dress on physical page address bus 58, sends a sig- 
nal to control logic 84 over line 95 to indicate that the 
current speculative page address is not accurate, and 
begins to transmit the accurate physical page ad- 
dress over physical page address bus 58. 

In response to the signal on line 95, control logic 
84 transmits a signal on line 33 to indicate that the 
physical address on bus 32 is no longer a speculative 
address. Upon receipt of the signal on line 33, mem- 
ory 16 aborts the lookup operation based on the 
speculative address and initiates a search based on 
the accurate physical address. 

Speculative address generating unit 42 is config- 
ured to generate a speculative page address based 
on the accurate physical page address most recently 
generated by translation lookaside buffer 62 for infor- 
mation of the same type as the information that is cur- 
rently required. For example, if, in response to the last 



request for an instruction, the translation lookaside 
buffer 62 generated a physical page address 0, then 
speculative address generating unit 42 will generate, 
in response to a request for the retrieval of an instruc- 

5 tion, page address 0 as a speculative page address. 
Similarly, if, in response to the last request for data, 
the translation lookaside buffer 62 generated physi- 
cal page address 1, then speculative address gener- 
ating unit 42 will generate, in response to a request 

10 for the retrieval of data, page address 1 as a specu- 
lative page address. 

Speculative address generating unit 42 imple- 
ments the above prediction process as follows. After 
translation lookaside buffer 62 generates an accurate 

is physical page address, translation lookaside buffer 
62 transmits the accurate physical page address over 
bus 73 to instruction address latch 86 and data ad- 
dress latch 88. In response to the signal on line 30, 
control logic 84 determines whether the accurate 

20 physical page address was generated in response to 
a request for an instruction or a request for data. If the 
accurate physical page address was generated in re- 
sponse to a request for an instruction, control logic 84 
transmits a control signal over line 92 to instruction 

25 address latch 86 to cause the accurate physical page 
address on bus 73 to be latched into instruction ad- 
dress latch 86. On the other hand, if the accurate 
physical page address was generated in response to 
a request for data, control logic 84 transmits a control 

30 signal over line 94 to data address latch 88 to cause 
the accurate physical page address on bus 73 to be 
latched into data address latch 88. 

In response to a subsequent request for informa- 
tion, control logic 84 transmits a signal over line 96 

35 to multiplexer 90 to select either instruction address 
latch 86 or data address latch 88. Specifically, if the 
signal on line 30 indicates that an instruction is being 
requested by processor core 12, then control logic 84 
transmits a signal over line 96 to multiplexer 90 to 

40 cause the page address previously stored in instruc- 
tion address latch 86 to be transmitted through mul- 
tiplexer 90 onto bus 74. If the signal on line 30 indi- 
cates that data is being requested by processor core 
12, control logic 84 transmits a signal over line 96 to 

45 multiplexer 90 to cause the page address stored in in- 
struction address latch 86 to be transmitted through 
multiplexer 90 onto bus 74. 

Thus, the preferred embodiment of speculative 
address generating unit 42 stores the most recently 

so generated actual page address for an instruction re- 
quest in instruction address latch 86, and the most re- 
cently generated actual page address for a data re- 
quest in data address latch 88. When a request for an 
instruction is received, speculative address generat- 

55 ing unit 42 immediately transmits the contents of in- 
struction address latch 86 as a speculative page ad- 
dress. Likewise, when a request for data is received, 
speculative address generating unit 42 immediately 
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transmits the contents of data address latch 88 as a 
speculative page address. 

The physical page of the currently required data 
or instruction is not necessarily the physical page of 
the most recently requested data or instruction. For 5 
this reason, the speculative page address must al- 
ways be checked against an accurate page address. 
However, related instructions tend to be clustered to- 
gether in memory, and related data tend to be clus- 
tered together in memory. Further, to perform any giv- 10 
en operation, a processor is generally required to exe- 
cute a plurality of related instructions on a plurality of 
related data. Consequently, there tends to be a high 
correlation between the physical page of data re- 
quested and the physical page of data previously re- 15 
quested. Likewise, there tends to be a high correla- 
tion between the physical page of instructions re- 
quested and the physical page of instructions previ- 
ously requested. The stronger these correlations, the 
more often the speculative address generated by 20 
speculative address generating unit 42 is accurate. 

As can be seen from the foregoing, an apparatus 
and method are provided which reduce the average 
time required to retrieve information from a physical- 
address-indexed cache in a virtual memory system. 25 
The access time is reduced by initiating a preliminary 
search for the required information while the virtual 
address generated by the processor core is being 
converted to an accurate physical address. The pre- 
liminary search is based on a speculative address, 30 
which, in the preferred embodiment of the invention, 
Is the physical address of the most recently retrieved 
information of the same type. Once an accurate phys- 
ical address has been determined, it is compared with 
the speculative address. If the speculative and the ac- 35 
tuai addresses match, then the preliminary search is 
allowed to complete. If the speculative and the actual 
addresses do not match, the preliminary search is 
aborted and a search is begun based on the accurate 
physical address. 40 

It is to be understood that the detailed drawings 
and specific examples given describe a preferred em- 
bodiment of the invention and are for the purpose of 
illustration only, and that the apparatus of the inven- 
tion Is not limited to the precise details and conditions 45 
disclosed. For example, while an internal virtual-ad- 
dress-indexed cache memory and an external phys- 
ical-address-indexed cache memory have been de- 
scribed, these caches may be either internal or exter- 
nal. In addition, while the present invention has been 50 
described with reference to a physical-address-in- 
dexed cache, it may alternatively be used with any 
physical-address-indexed memory, such as system 
memory. Various other changes may also be made 
without departing from the spirit of the invention 55 
which is defined by the following claims: 

The following clauses set out various aspects of 
the invention. 



1. An apparatus for use in a virtual memory sys- 
tem for reducing the delay between generation of 
a virtual address by a processor core and trans- 
mission to a memory of a physical address cor- 
responding to said virtual address, said genera- 
tion of said virtual address by said processor core 
effecting a request for required information, the 
apparatus comprising: 

a translation lookaside buffer operatively 
connected with said processor core and said 
memory for receiving said virtual address and 
generating an accurate physical address; 

a speculative address generating means 
operatively connected with said translation loo- 
kaside buffer and said memory for generating a 
speculative address, said speculative address 
generating means transmitting said speculative 
address to said memory prior to said translation 
lookaside buffer generating said accurate physi- 
cal address; 

comparing means, operatively connected 
with said translation lookaside buffer, said mem- 
ory and said speculative address generating 
means, for comparing said accurate physical ad- 
dress with said speculative address; 

said comparing means transmitting said 
accurate physical address to said memory when 
said accurate physical address does not match 
said speculative address. 

2. An apparatus for use in a virtual memory sys- 
tem as recited in clause 1 wherein said memory 
is configured to initiate a first lookup operation 
based on said speculative address substantially 
upon receipt of said speculative address, said 
speculative address generating means being 
configured to transmit to said memory a control 
signal indicative of whether said speculative ad- 
dress matches said accurate physical address, 
said memory being configured to abort said first 
lookup operation based on said speculative ad- 
dress and initiate a second lookup operation 
based on said accurate physical address when 
said control signal indicates that said speculative 
address does not match said accurate physical 
address. 

3. An apparatus for use in a virtual memory sys- 
tem as recited in clause 1 wherein said specula- 
tive address generating means includes storage 
means for storing a previous physical address, 
said previous physical address being a selected 
accurate physical address previously generated 
by said translation lookaside buffer, at least a 
portion of said speculative address being related 
with at least a portion of said previous physical 
address according to a predetermined relation- 
ship. 

4. An apparatus for use in a virtual memory sys- 
tem as recited in clause 3 wherein said virtual 



8 



15 



EP 0 668 565 A1 



16 



memory system includes a virtual-address- in- 
dexed cache memory operatively connected with 
said processor core, said virtual-address-in- 
dexed cache memory receiving said virtual ad- 
dress from said processor core and transmitting 5 
said required information to said processor core 
when said required information is present in said 
virtual-address-indexed cache memory. 

5. An apparatus for use in a virtual memory sys- 
tem as recited in clause 1 wherein said genera- 10 
tion of said virtual address by said processor core 
effects a present request for said required infor- 
mation, said present request being a present in- 
struction request when said required information 

is an instruction, said present request being a is 
present data request when said required informa- 
tion is data, said speculative address generating 
means including storage means for storing at 
least one previous Instruction address and at 
least one previous data address, said at least one 20 
previous instruction address being a first select- 
ed accurate physical address previously generat- 
ed by said translation lookaside buffer, said at 
least one previous data address being a second 
selected accurate physical address previously 25 
generated by said translation lookaside buffer, at 
least a portion of said speculative address being 
related with at least a portion of said at least one 
previous instruction address according to a pre- 
determined relationship when said present re- 30 
quest is said present instruction request, at least 
a portion of said speculative address being relat- 
ed with at least a portion of said at least one pre- 
vious data address according to a predetermined 
relationship when said present request is said 35 
present data request. 

6. An apparatus for use in a virtual memory sys- 
tem as recited in clause 1 wherein said memory 
is a cache memory configured to supply said re- 
quired information in response to said physical 40 
address. 

7. An apparatus for reducing the time required for 
a processor core in a virtual memory system to 
retrieve information from a memory configured to 
supply information in response to a physical ad- 45 
dress, the apparatus comprising: 

accurate physical address generating 
means, operatively connected with said proces- 
sor core and said memory, for receiving a virtual 
address corresponding to an accurate physical so 
address and for generating said accurate physn 
cal address; 

speculative address generating means, 
operatively connected with said memory, for gen- 
erating a speculative physical address prior to 55 
said accurate physical address generating 
means generating said accurate physical ad- 
dress, said speculative address generating 



means transmitting said speculative physical ad- 
dress to said memory to initiate a first lookup op- 
eration in said memory based on said speculative 
physical address; 

comparing means operatively connected 
with said accurate physical address generating 
means, said memory and said speculative ad- 
dress generating means for receiving said accu- 
rate physical address from said accurate physical 
address generating means and receiving said 
speculative physical address from said specula- 
tive address generating means, said comparing 
means comparing said accurate physical address 
with said speculative physical address; 

said comparing means transmitting said 
accurate physical address to said memory to ini- 
tiate a second lookup operation based on said ac- 
curate physical address when said accurate 
physical address is different from said specula- 
tive physical address. 

8. An apparatus for reducing the time required for 
a processor core in a virtual memory system to 
retrieve information from a memory configured to 
supply information in response to a physical ad- 
dress, as recited in clause 7, wherein said mem- 
ory is configured to initiate a first lookup opera- 
tion based on said speculative physical address 
substantially upon receipt of said speculative 
physical address, said speculative address gen- 
erating means being configured to transmit a 
control signal to said memory, said control signal 
being indicative of whether said speculative 
physical address matches said accurate physical 
address, said memory being configured to abort 
said first lookup operation based on said specu- 
lative physical address and initiate a second look- 
up operation based on said accurate physical ad- 
dress when said control signal indicates that said 
speculative physical address does not match said 
accurate physical address. 

9. An apparatus for reducing the time required for 
a processor core in a virtual memory system to 
retrieve information from a memory configured to 
supply information in response to a physical ad- 
dress, as recited in clause 7, wherein said spec- 
ulative address generating means is operatively 
connected with said accurate physical address 
generating means, said speculative address gen- 
erating means including storage means for stor- 
ing at least one previous physical address, said 
at least one previous physical address being a se- 
lected accurate physical address previously gen- 
erated by said accurate physical address gener- 
ating means, at least a portion of said speculative 
physical address being related with at least a por- 
tion of said at least one previous physical address 
according to a predetermined relationship. 

10. An apparatus for reducing the time required 
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for a processor core in a virtual memory system 
to retrieve information from a memory configured 
to supply information in response to a physical 
address, as recited in clause 9, wherein said vir- 
tual memory system includes a virtual-address- 5 
indexed cache memory operattvely connected 
with said processor core, said processor core 
generating said virtual address to effect a re- 
quest for required information, said virtual-ad- 
dress-indexed cache memory receiving said vir- 10 
tual address from said processor core, said vir- 
tual-address-indexed cache memory transmit- 
ting said required information to said processor 
core when said required information is present in 
said virtuai-address-indexed cache memory. is 

11. An apparatus for reducing the time required 
for a processor core in a virtual memory system 
to retrieve information from a memory configured 
to supply Information in response to a physical 
address, as recited in clause 7, wherein said 20 
processor core generates said virtual address to 
effect a present request for said information, said 
present request being a present instruction re- 
quest when said information is an instruction, 

said present request being a present data request 25 
when said information is data, said speculative 
address generating means including storage 
means for storing at least one previous instruc- 
tion address and at least one previous data ad- 
dress, said at least one previous instruction ad- 30 
dress being an accurate physical address previ- 
ously generated by said accurate physical ad- 
dress generating means, said at least one previ- 
ous data address being an accurate physical ad- 
dress previously generated by said accurate 35 
physical address generating means in response 
to said at least one previous data request, at least 
a portion of said speculative physical address be- 
ing related with at least a portion of said at least 
one previous instruction address according to a 40 
predetermined relationship when said present re- 
quest is said present instruction request, at least 
a portion of said speculative physical address be- 
ing related with at least a portion of said at least 
one previous data address according to a prede- 45 
termined relationship when said present request 
is said present data request 

12. A logical-to-physical address translation unit 
for transmitting a physical address over a bus in 
response to a virtual address, comprising: so 

accurate translation means for receiving 
said virtual address and translating said virtual 
address to an accurate physical address; 

speculative translation means, operative- 
ly connected with said accurate translation 55 
means, for generating a speculative physical ad- 
dress; 

comparing means operatively connected 



with said accurate translation means, said spec- 
ulative translation means and said bus, for trans- 
mitting said speculative physical address as said 
physical address over said bus prior to comple- 
tion of said generation of said accurate physical 
address, for comparing said accurate physical 
address with said speculative physical address, 
and for aborting transmission of said speculative 
physical address over said bus and initiating 
transmission of said accurate physical address 
over said bus when said accurate physical ad- 
dress does not match said speculative physical 
address. 

13. A logical-to-physical address translation unit 
for transmitting a physical address in response to 
a virtual address, as recited in clause 12, further 
comprising a memory operatively connected with 
said bus, said memory being configured to ini- 
tiate a first lookup operation based on said spec- 
ulative physical address substantially upon re- 
ceipt of said speculative physical address over 
said bus, said speculative translation means be- 
ing configured to transmit a control signal to said 
memory, said control signal being indicative of 
whether said speculative physical address 
matches said accurate physical address, said 
memory being configured to abort said first look- 
up operation based on said speculative physical 
address and initiate a second lookup operation 
based on said accurate physical address when 
said control signal indicates that said speculative 
physical address does not match said accurate 
physical address. 

14. A logical-to-physlcal address translation unit 
for transmitting a physical address in response to 
a virtual address, as recited in clause 12, wherein 
said accurate translation means is a translation 
lookaside buffer. 

15. A logical-to-physical address translation unit 
for transmitting a physical address in response to 
a virtual address, as recited in clause 12, wherein 
said virtual address comprises a virtual page por- 
tion and an offset portion, said accurate transla- 
tion means generating an accurate physical page 
address, said accurate physical address compris- 
ing said accurate physical page address and said 
offset portion, said speculative translation 
means generating a speculative page address, 
said speculative physical address comprising 
said speculative page address and said offset 
portion. 

16. A logical-to-physical address translation unit 
for transmitting a physical address in response to 
a virtual address, as recited in clause 12, wherein 
said speculative translation means includes stor- 
age means for storing at least one previous phys- 
ical address, said at least one previous physical 
address being a selected accurate physical ad- 
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dress previously generated by said accurate 
translation means, at least a portion of said spec- 
ulative physical address being related with said at 
least one previous physical address according to 
a predetermined relationship. s 

17. A logical-to-physical address translation unit 
for transmitting a physical address in response to 
a virtual address, as recited in clause 12. wherein 
said virtual address represents a present request 

for required information, said present request be- 10 
ing a present instruction request when said re- 
quired information is an instruction, said present 
request being a present data request when said 
required information is data, said speculative 
translation means including storage means for is 
storing at least one previous instruction address 
and at least one previous data address, said at 
least one previous instruction address being a 
first selected accurate physical address previ- 
ously generated by said accurate translation 20 
means, said at least one previous data address 
being a second selected accurate physical ad- 
dress previously generated by said accurate 
translation means, at least a portion of said spec- 
ulative physical address being related with at 25 
least a portion of said at least one previous in- 
struction address according to a predetermined 
relationship when said present request is said 
present instruction request, at least a portion of 
said speculative physical address being related 30 
with at least a portion of said at least one previous 
data address according to a predetermined rela- 
tionship when said present request is said pres- 
ent data request. 

18. A virtual memory system, including: 35 

a processor core disposed to generate a 
virtual address representative of required infor- 
mation; 

a first cache disposed to supply informa- 
tion in response to virtual addresses, said first 40 
cache being operativety connected with said 
processor core for receiving said virtual address 
from said processor core, said first cache includ- 
ing a first plurality of storage locations for storing 
information, said first cache transmitting said re- 45 
quired information to said processor core in re- 
sponse to receipt of said virtual address when 
said required information resides in said first plur- 
ality of storage locations; 

a logical-to-physical address translation so 
means, operatively connected with said proces- 
sor core, for receiving said virtual address, for 
generating a physical address in response to said 
virtual address, and for transmitting said physical 
address; and 55 

a second cache disposed to supply Infor- 
mation in response to physical addresses, said 
second cache being operatively connected with 



said logical-to-physical address translation 
means and to said processor core, for receiving 
said physical address from logical-to-physical 
address translation means, said second cache 
including a second plurality of storage locations 
for storing information, said second cache initiat- 
ing a lookup operation for said required informa- 
tion in response to receipt of said physical ad- 
dress, said second cache transmitting said re- 
quired information to said processor core when 
said required information resides in said second 
plurality of storage locations; 

said logical-to-physical address transla- 
tion means including; 

accurate translation means for re- 
ceiving said virtual address and for translating 
said virtual address to an accurate physical ad- 
dress, 

speculative translation means, op- 
eratively connected with said accurate transla- 
tion means, for generating a speculative physical 
address, 

comparing means operatively con- 
nected with said accurate address generating 
means, said speculative address generating 
means and said second cache, for transmitting 
said speculative physical address as said physi- 
cal address to said second cache prior to comple- 
tion of said generation of said accurate physical 
address, for comparing said accurate physical 
address to said speculative physical address, 
and for aborting transmission of said speculative 
physical address to said second cache and initiat- 
ing transmission of said accurate physical ad- 
dress to said second cache when said accurate 
physical address does not match said speculative 
physical address. 

19. A virtual memory system, as recited in clause 
18, wherein said second cache is configured to 
initiate a first lookup operation based on said 
speculative physical address substantially upon 
receipt of said speculative physical address, said 
speculative translation means being configured 
to transmit a control signal to said second cache, 
said control signal being Indicative of whether 
said speculative physical address matches said 
accurate physical address, said second cache 
being configured to abort said first lookup oper- 
ation based on said speculative physical address 
and initiate a second lookup operation based on 
said accurate physical address when said control 
signal indicates that said speculative physical ad- 
dress does not match said accurate physical ad- 
dress. 

20. A virtual memory system, as recited in of 
clause 18, wherein said accurate translation 
means is a translation lookaside buffer. 

21. A virtual memory system, as recited in clause 
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18, wherein said virtual address comprises a vir- 
tual page portion and an offset portion, said ac- 
curate translation means generating an accurate 
physical page address, said accurate physical 
address comprising said accurate physical page 5 
address and said offset portion, said speculative 
translation means generating a speculative page 
address, said speculative physical address com- 
prising said speculative page address and said 
offset portion. w 

22. A virtual memory system, as recited in clause 
18, wherein said speculative translation means 
includes storage means for storing at least one 
previous physical address, said at least one pre- 
vious physical address being a selected accurate is 
physical address previously generated by said 
accurate translation means, at least a portion of 
said speculative physical address being related 

with at least a portion of said at least one previous 
physical address according to a predetermined 20 
relationship. 

23. A virtual memory system, as recited in clause 
18, wherein said generation of said virtual ad- 
dress by said processor core effects a present re- 
quest for said required information, said present 25 
request being a present instruction request when 
said required information is an instruction, said 
present request being a present data request 
when said required information is data, said spec- 
ulative translation means including storage 30 
means for storing at least one previous instruc- 
tion address and at least one previous data ad- 
dress, said at least one previous instruction ad- 
dress being a first selected accurate physical ad- 
dress previously generated by said accurate 35 
translation means, said at least one previous 
data address being a second selected accurate 
physical address previously generated by said 
accurate translation means, at least a portion of 
said speculative physical address being related 40 
with at least a portion of said at least one previous 
instruction address according to a predetermined 
relationship when said present request is said 
present instruction request, at least a portion of 
said speculative physical address being related 45 
with at least a portion of said at least one previous 
data address according to a predetermined rela- 
tionship when said present request is said pres- 
ent data request. 

24. A virtual memory system, as recited in clause so 
18, wherein said processor core, said logical-to- 
physical address translation means, and said 

first cache reside on a single processor chip. 

25. A virtual memory system, as recited in clause 

24, wherein said second cache resides external 55 
to said single processor chip. 

26. A method for converting a virtual address to 
a physical address in a system including a proc- 



essor core configured to generate said virtual ad- 
dress to request required information from a 
memory, comprising the steps of: 

initiating a conversion operation to convert 
said virtual address to an accurate physical ad- 
dress; 

generating a speculative physical ad- 
dress; 

transmitting said speculative physical ad- 
dress to said memory prior to completion of said 
conversion operation; 

comparing said accurate physical address 
to said speculative physical address; and 

terminating said transmission of said 
speculative physical address to said memory, 
and initiating transmission of said accurate phys- 
ical address to said memory, when said accurate 
physical address does not match said speculative 
physical address. 

27. A method for converting a virtual address to 
a physical address in a system including a proc- 
essor core configured to generate said virtual ad- 
dress to request required information from a 
memory, as recited in clause 26, including the 
further steps of causing said memory to initiate a 
first lookup operation based on said speculative 
physical address substantially upon receipt of 
said speculative physical address, and causing 
said memory to abort said first lookup operation 
based on said speculative physical address and 
initiate a second lookup operation based on said 
accurate physical address when said speculative 
physical address does not match said accurate 
physical address. 

28. A method for converting a virtual address to 
a physical address in a system including a proc- 
essor core configured to generate said virtual ad- 
dress to request required information from a 
memory, as recited in clause 26, wherein said 
conversion operation is performed by a lookaside 
translation buffer. 

29. A method for converting a virtual address to 
a physical address in a system including a proc- 
essor core configured to generate said virtual ad- 
dress to request required information from a 
memory, as recited in dause 26, wherein said vir- 
tual address has a virtual page portion and an 
offset portion, said conversion operation includ- 
ing converting said virtual page portion to an ac- 
curate physical page address. 

30. A method for converting a virtual address to 
a physical address in a system including a proc- 
essor core configured to generate said virtual ad- 
dress to request required information from a 
memory, as recited in clause 29, wherein said 
step of generating includes generating a specu- 
lative physical page address. 

31. A method for converting a virtual address to 
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a physical address in a system including a proc- 
essor core configured to generate said virtual ad- 
dress to request required information from a 
memory, as recited in clause 30, wherein said 
step of transmitting said speculative physical ad- 5 
dress includes transmitting said speculative 
physical page address and said offset portion. 

32. A method for converting a virtual address to 
a physical address in a system including a proc- 
essor core configured to generate said virtual ad- 10 
dress to request required information from a 
memory, as recited in clause 31, wherein said 
step of transmitting said accurate physical ad- 
dress includes transmitting said accurate physi- 
cal page address and said offset portion. is 

33. A method for converting a virtual address to 
a physical address in a system including a proc- 
essor core configured to generate said virtual ad- 
dress to request required information from a 
memory, as recited in clause 26, wherein said 20 
processor core further generates a status signal 
representative of whether said required informa- 
tion represents an Instruction or data, the method 
further including the step of receiving said status 
signal, said generation of said speculative page 25 
address being responsive to said status signal. 

34. A method for converting a virtual address to 
a physical address in a system including a proc- 
essor core configured to generate said virtual ad- 
dress to request required information from a 30 
memory, as recited in clause 33, wherein said 
generation of said speculative physical address 

is further responsive to a previously-generated 
accurate physical address. 

35. A method for converting a virtual address to 35 
a physical address in a system including a proc- 
essor core configured to generate said virtual ad- 
dress to request required information from a 
memory, as recited in clause 34, said virtual ad- 
dress effecting a present request for said re- 40 
quired information, said present request being a 
present data request when said required informa- 
tion is data, said present request being a present 
instruction request when said requested informa- 
tion is an instruction, wherein said step of gener- 45 
ating said speculative physical address includes 

the steps of: 

storing a first previously-generated accu- 
rate physical address, said first previously-gener- 
ated accurate physical address being a first se- so 
lected accurate physical address generated pre- 
vious to said accurate physical address in re- 
sponse to a previous data request; 

storing a second previously-generated ac- 
curate physical address, said second previously- 55 
generated accurate physical address being a 
second selected accurate physical address gen- 
erated previous to said accurate physical address 



in response to a previous instruction request; 

generating said first previously-generated 
accurate physical address when said status sig- 
nal Indicates said required information repre- 
sents data; and 

generating said second previously-gener- 
ated accurate physical address when said status 
signal indicates said required information repre- 
sents an instruction. 



Claims 

1. An apparatus for use in a virtual memory system 
for reducing the delay between generation of a 
virtual address by a processor core and transmis- 
sion to a memory of a physical address corre- 
sponding to said virtual address, said generation 
of said virtual address by said processor core ef- 
fecting a request for required information, the ap- 
paratus comprising; 

a translation lookaside buffer operatively 
connected with said processor core and said 
memory for receiving said virtual address and 
generating an accurate physical address; 

a speculative address generating means 
operatively connected with said translation loo- 
kaside buffer and said memory for generating a 
speculative address, said speculative address 
generating means transmitting said speculative 
address to said memory prior to said translation 
lookaside buffer generating said accurate physi- 
cal address; 

comparing means, operatively connected 
with said translation lookaside buffer, said mem- 
ory and said speculative address generating 
means, for comparing said accurate physical ad- 
dress with said speculative address; 

said comparing means transmitting said 
accurate physical address to said memory when 
said accurate physical address does not match 
said speculative address. 

2. An apparatus for use in a virtual memory system 
as recited in Claim 1 wherein said memory Is con- 
figured to initiate a first lookup operation based 
on said speculative address substantially upon 
receipt of said speculative address, said specu- 
lative address generating means being config- 
ured to transmit to said memory a control signal 
indicative of whether said speculative address 
matches said accurate physical address, said 
memory being configured to abort said first look- 
up operation based on said speculative address 
and initiate a second lookup operation based on 
said accurate physical address when said control 
signal indicates that said speculative address 
does not match said accurate physical address. 
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An apparatus for use in a virtual memory system 
as recited in Claim 1 wherein said speculative ad- 
dress generating means includes storage means 
for storing a previous physical address, said pre- 
vious physical address being a selected accurate 5 
physical address previously generated by said 
translation lookaside buffer, at least a portion of 
said speculative address being related with at 
least a portion of said previous physical address 
according to a predetermined relationship. 10 

An apparatus for use in a virtual memory system 
as recited in Claim 3 wherein said virtual memory 
system includes a virtual-address-indexed cache 
memory operatively connected with said proces- is 
sor core, said virtual-address-indexed cache 
memory receiving safd virtual address from said 
processor core and transmitting said required in- 
formation to said processor core when said re- 
quired information is present in said virtual-ad- 20 
dress-indexed cache memory. 

An apparatus for use in a virtual memory system 
as recited in Claim 1 wherein said generation of 
said virtual address by said processor core ef- 25 
fects a present request for said required informa- 
tion, said present request being a present instruc- 
tion request when said required information is an 
instruction, said present request being a present 
data request when said required information is 30 
data, said speculative address generating means 
including storage means for storing at least one 
previous instruction address and at least one pre- 
vious data address, said at least one previous in- 
struction address being a first selected accurate 35 
physical address previously generated by said 
translation lookaside buffer, said at least one pre- 
vious data address being a second selected ac- 
curate physical address previously generated by 
said translation lookaside buffer, at least a por- 40 
tion of said speculative address being related 
with at least a portion of said at least one previous 
instruction address according to a predetermined 
relationship when said present request is said 
present instruction request at least a portion of 45 
said speculative address being related with at 
least a portion of said at least one previous data 
address according to a predetermined relation- 
ship when said present request is said present 
data request. so 

An apparatus for use in a virtual memory system 
as recited in Claim 1 wherein said memory is a 
cache memory configured to supply said required 
information in response to said physical address. 55 

An apparatus for reducing the time required for a 
processor core in a virtual memory system to re- 



trieve information from a memory configured to 
supply information in response to a physical ad- 
dress, the apparatus comprising: 

accurate physical address generating 
means, operatively connected with said proces- 
sor core and said memory, for receiving a virtual 
address corresponding to an accurate physical 
address and for generating said accurate physi- 
cal address; 

speculative address generating means, 
operatively connected with said memory, for gen- 
erating a speculative physical address prior to 
said accurate physical address generating 
means generating said accurate physical ad- 
dress, said speculative address generating 
means transmitting said speculative physical ad- 
dress to said memory to initiate a first lookup op- 
eration in said memory based on said speculative 
physical address; 

comparing means operatively connected 
with said accurate physical address generating 
means, said memory and said speculative ad- 
dress generating means for receiving said accu- 
rate physical address from said accurate physical 
address generating means and receiving said 
speculative physical address from said specula- 
tive address generating means, said comparing 
means comparing said accurate physical address 
with said speculative physical address; 

said comparing means transmitting said 
accurate physical address to said memory to ini- 
tiate a second lookup operation based on said ac- 
curate physical address when said accurate 
physical address Is different from said specula- 
tive physical address. 

8. A logical- to- physical address translation unit for 
transmitting a physical address over a bus in re- 
sponse to a virtual address, comprising: 

accurate translation means for receiving 
said virtual address and translating said virtual 
address to an accurate physical address; 

speculative translation means, operative- 
ly connected with said accurate translation 
means, for generating a speculative physical ad- 
dress; 

comparing means operatively connected 
with said accurate translation means, said spec- 
ulative translation means and said bus, for trans- 
mitting said speculative physical address as said 
physical address over said bus prior to comple- 
tion of said generation of said accurate physical 
address, for comparing said accurate physical 
address with said speculative physical address, 
and for aborting transmission of said speculative 
physical address over said bus and initiating 
transmission of said accurate physical address 
over said bus when said accurate physical ad- 
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dress does not match said speculative physical 
address. 

A virtual memory system, including: 

a processor core disposed to generate a 5 
virtual address representative of required infor- 
mation; 

a first cache disposed to supply informa- 
tion in response to virtual addresses, said first 
cache being operatively connected with said 10 
processor core for receiving said virtual address 
from said processor core, said first cache includ- 
ing a first plurality of storage locations for storing 
information, said first cache transmitting said re- 
quired information to said processor core in re- 15 
sponse to receipt of said virtual address when 
said required information resides in said first plur- 
ality of storage locations; 

a logical-to-physlcal address translation 
means, operatively connected with said proces- 20 
sor core, for receiving said virtual address, for 
generating a physical address in response to said 
virtual address, and for transmitting said physical 
address; and 

a second cache disposed to supply infor- 25 
mation in response to physical addresses, said 
second cache being operatively connected with 
said logical-to-physical address translation 
means and to said processor core, for receiving 
said physical address from logical-to-physical 30 
address translation means, said second cache 
including a second plurality of storage locations 
for storing information, said second cache initiat- 
ing a lookup operation for said required informa- 
tion in response to receipt of said physical ad- 35 
dress, said second cache transmitting said re- 
quired information to said processor core when 
said required information resides in said second 
plurality of storage locations; 

said logical-to-physical address trans I a- 40 
tion means including: 

accurate translation means for re- 
ceiving said virtual address and for translating 
said virtual address to an accurate physical ad- 
dress, 45 

speculative translation means, op- 
eratively connected with said accurate transla- 
tion means, for generating a speculative physical 
address, 

comparing means operatively con- so 
nected with said accurate address generating 
means, said speculative address generating 
means and said second cache, for transmitting 
said speculative physical address as said physi- 
cal address to said second cache prior to com pie- 55 
tion of said generation of said accurate physical 
address, for comparing said accurate physical 
address to said speculative physical address, 



and for aborting transmission of said speculative 
physical address to said second cache and initiat- 
ing transmission of said accurate physical ad- 
dress to said second cache when said accurate 
physical address does not match said speculative 
physical address. 

10. A method for converting a virtual address to a 
physical address in a system including a proces- 
sor core configured to generate said virtual ad- 
dress to request required information from a 
memory, comprising the steps of: 

initiating a conversion operation to convert 
said virtual address to an accurate physical ad- 
dress; 

generating a speculative physical ad- 
dress; 

transmitting said speculative physical ad- 
dress to said memory prior to completion of said 
conversion operation; 

comparing said accurate physical address 
to said speculative physical address; and 

terminating said transmission of said 
speculative physical address to said memory, 
and initiating transmission of said accurate phys- 
ical address to said memory, when said accurate 
physical address does not match said speculative 
physical address. 

11. A method for converting a virtual address to a 
physical address in a system including a proces- 
sor core configured to generate said virtual ad- 
dress to request required information from a 
memory, as recited in Claim 10, including the fur- 
ther steps of causing said memory to initiate a 
first lookup operation based on said speculative 
physical address substantially upon receipt of 
said speculative physical address, and causing 
said memory to abort said first lookup operation 
based on said speculative physical address and 
initiate a second lookup operation based on said 
accurate physical address when said speculative 
physical address does not match said accurate 
physical address. 

11 A method for converting a virtual address to a 
physical address in a system including a proces- 
sor core configured to generate said virtual ad- 
dress to request required information from a 
memory, as recited in Claim 10, wherein said 
conversion operation is performed by a lookaside 
translation buffer. 

13. A method for converting a virtual address to a 
physical address in a system including a proces- 
sor core configured to generate said virtual ad- 
dress to request required information from a 
memory, as recited in Claim 10, wherein said vir- 




29 EP 0 668 565 A1 

tual address has a virtual page portion and an 
offset portion, said conversion operation includ- 
ing converting said virtual page portion to an ac- 
curate physical page address. 
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